Kushner Equation

In filtering theory the Kushner equation (after Harold Kushner) is an equation for the conditional probability density of the state of a stochastic non-linear dynamical system, given noisy measurements of the state. It therefore provides the solution of the nonlinear filtering problem in estimation theory. The equation is sometimes referred to as the Stratonovich–Kushner Stratonovich, R.L. (1960). ''Conditional Markov Processes''. Theory of Probability and Its Applications, 5, pp. 156–178. (or Kushner–Stratonovich) equation.

Overview

Assume the state of the system evolves according to

:$dx = f(x,t) \, dt + \sigma dw$

and a noisy measurement of the system state is available:

:$dz = h(x,t) \, dt + \eta dv$

where ''w'', ''v'' are independent Wiener processes. Then the conditional probability density ''p''(''x'', ''t'') of the state at time ''t'' is given by the Kushner equation:

:dp(x,t) = L (x,t)dt + p(x,t) (x,t)-E_t h(x,t) \top \eta^\eta^ z-E_t h(x,t) dt

where $L p = -\sum \frac + \frac \sum (\sigma \sigma^\top)_ \frac$ is the Kolmogorov Forward operator and $dp(x,t) = p(x,t + dt) - p(x,t)$ is the variation of the conditional probability.

The term $dz-E_t h(x,t) dt$ is the innovation i.e. the difference between the measurement and its expected value.

Kalman–Bucy filter

One can simply use the Kushner equation to derive the Kalman–Bucy filter for a linear diffusion process. Suppose we have $f(x,t) = a x$ and $h(x,t) = c x$. The Kushner equation will be given by
:
dp(x,t) = L (x,t)dt + p(x,t) x- c \mu(t)\top \eta^\eta^ z-c \mu(t) dt

where $\mu(t)$ is the mean of the conditional probability at time $t$. Multiplying by $x$ and integrating over it, we obtain the variation of the mean
:$d\mu(t) = a \mu(t) dt + \Sigma(t) c^\top \eta^\eta^ \left(dz - c\mu(t) dt\right).$
Likewise, the variation of the variance $\Sigma(t)$ is given by
:$\frac = a\Sigma(t) + \Sigma(t) a^\top + \sigma^\top \sigma-\Sigma(t) c^\top\eta^ \eta^ c \Sigma(t).$
The conditional probability is then given at every instant by a normal distribution $\mathcal(\mu(t),\Sigma(t))$.

See also

* Zakai equation

References

{{Reflist

Signal estimation
Nonlinear filters